WO 2005/089369 



PCT/US2005/008727 



APPARATUS FOR IMAGING USING AN ARRAY OF LENSES 
Background of Invention 
Beld of Invention 

The invention relates mainly to digital imaging and photographic 
camera technology for detection of electromagnetic radiation. 

Other areas 

Other potential areas can be systems for digital photography and 
imaging, medical, research, industrial, civil and military surveillance, 
monitoring and automatic sensor function. The electromagnetic radiation to 
be detected can be of all kinds including but not limited to ordinary visible 
light, UV-light, IR-lightand THz -radiation. 

Examples of applications for this technology: 

Motion Detectors with Imaging Capability 

Biological, Medical and Surgical Imaging 

Cell and Sub-cellular Imaging 

Implanted Devices 

Micron and Nanosized Vehicles for guidance and 
reconnaissance 

Imaging from Aircraft, Space Vehicles or Rovers, particularly 
small robotically controlled vehicles, such as Micro or Nano 
Unmanned Aerial Vehicle (MUAV, NUAV) 
Ultralight large arrays for Space and Astronomical Imaging. 
Description of Related Art 
Previously employed technique/technology (construction and function) 

In today's digital cameras one (or more) lenses are always used to 
focus and to define the image onto the focal plane where the light sensitive 
device (i.e. usually a CCD-plate) is situated. On top of the light sensitive 
device sometimes a micro lens is placed in order to harvest as much light as 
possible to the individual light sensitive components. 

Problems with employed technology 
There is an ongoing trend to make cameras and imaging systems 
smaller and smaller in order to increase application area. In today's digital 
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cameras one (or more) millimeter or larger lenses are always used to focus 
and to define the image onto the focal plane where the light sensitive device 
(Le. usually a CCD-plate) is situated. On top of the light sensitive device 
sometimes a micro lens is placed in order to harvest as much light as 
possible to the individual light sensitive components. This construction 
necessitate the use of a relatively large lens system which in turn means that 
the cost for such an apparatus is high as well as the actual size of the 
apparatus will be dictated by the lens system employed. This makes it 
impossible to shrink optical cameras to dimensions that will be compatible 
with nanodevice applications such as guiding micron sized autonomous 
systems for microsurgery, surveillance, reconnaissance and other future 
converging technologies. 

Imaging devices are inherently more complex than sensors and thus 
present unique problems as compared to nano or micron-sized/transducers 
that sense various forms of energy including simple light detectors. 

Ordinary cameras as outlined above use a single large lens or 
recently one lens per pixel, as a condenser in order to increase imaging 
sensitivity, which means it acts as a light sensor incapable of producing 
images. If one would have one lens for many pixel elements when trying to 
make such imaging systems smaller, one would be hindered from obtaining 
good imaging capability due to diffraction limits. Thus physical laws limit the J 
usefulness e.g. in millimeter sized imaging devices having rather low 
resolution. If one further reduces a conventional camera design to extremely 
small proportions i.e. nano-size, far field light waves will be blocked at 
wavelengths larger than the physical size of the aperture. 

Summary of the Invention 

The inventive imaging apparatus consists of multiple optical elements 
of sub-micron, nanometer scale supported onto a partly or fully radiation 
transmitting layer, which in turn is situated on top of a radiation sensitive layer 
being patterned so that under each optical element there exists at least more 
than one radiation harvesting element that may be individually affected by 
radiation. The material of the individual optical elements has a property that 
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causes them to function as lenses. A partly or fully radiation transmitting 
layer may consist of homogenous material or heterogeneous material, e.g. a 
layer consisting of fiber, spacer or a fluid or combinations thereof, being 
malleable by changing its volume, spacing, curvature, other shape change, or 
chemistry. The functions of focusing, light filtering, optical correction or 
zooming can be achieved by fluidic, capillary force, molecular rearrangement 
or chemistry, as well as nano-sized levers or fibers to adjust size or refractive 
property of the optical system. The optical elements may also be composed 
of different layers of refractive material enabling radiation of different 
wavelengths to be manipulated during the path through the optical element to 
compensate for chromatic aberration effects etc. in accordance with the art of 
such radiation control by proper choice of lens material. The material and 
malleability of the individual optical elements and system have a property or 
properties that cause them to be } capable of focusing, zooming, light filtering 
and optical aberration correction. 

Preferably, in the inventive imaging apparatus, the radiation 
harvesting elements will work as a photoelectric device that will produce an 
electronic signal. Such an electronic signal produced may preferably be 
monitored and/or manipulated by electronic digital processing making an 
electronic read-out possible. By image enhancing processing algorithms, 
overlapping information as described above from physically (geometrically) or 
electronically defined arrays of sensors or "sectors" one can obtain a high 
resolution image. Since each of the individual lenses or groups of lenses will 
have a slightly different spatial viewpoint, the multiple information from 
electronically or geometrically defined multiple sectors of the array of sensors 
e.g. left and right sector, can be processed to obtain 3-D or stereotypic 
images. 

The invention also includes a digital camera comprising the imaging 
apparatus described above in combination with a shutter layer or layers which 
can be made with dimensions barely visible to ordinary vision or incorporated 
into either large, micro-sized or nano-sized devices e.g. credit card, button, 
pin, medical device, etc. 
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All functional elements of the imaging apparatus and/or camera as 
described above can be made out of various kind of materials and in one 
implementation be made out of flexible material. The optical elements may 
be arranged cylindrically as on a flexible tape, or spherically to obtain wide 
angle views. It can also be used for wide angle view detection by curving the 
sensor array in a 2-dimensional fashion combined with stitching the 
information together thereby producing up to 360 degree panoramic imaging. 

The inventive imaging apparatus can also be used for wide angle view 
detection by spherizing the sensor array in a 3-dirnensionaI fashion combined 
with stitching the information together thereby producing a full 360 degree 
"fish-eye" imaging capability in all 3-dimensions. Image processing can 
produce projections known photographically as "fisheye" i.e. circular, 
rectilinear, or other flat map projections. 

In one embodiment, color imaging and spectroscopic imaging can be 
obtained by utilizing equal sized lenses and using multi-wavelength sensing 
layers below the lenses. 

The imaging apparatus and/or camera as described above can be 
employed for spectroscopic imaging and/or spectroscopy taking advantage of 
the optical properties of nano-scaled lenses by controlling the diameter of the 
lenses at a nanometer level thereby accepting various wavelengths below the 
diffraction limit as illustrated in, but not limited by, the two following 
examples: 

A) In one configuration stepwise sized lenses with gradually 
increasing/decreasing diameter could be employed by utilizing processing to 
remove the cumulative component of the incrementally larger lenses, e.g. 
having the smallest diameter lens being capable of admitting only the UV-Iight 
waves and the largest diameter lens admitting all wavelengths up to IR- 
radiation. 

B) In another configuration color imaging can be achieved by 
controlling the diameter of a limited set of 2, 3 or more lenses at a nanometer 
level. Lenses with different diameters could be utilized to detect discrete 
wavelengths which subsequently are additively combined to produce a color- 
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code necessary for standard (e.g. RGB, CMYK) or false color processing. 

The electronic read-out signal as described above may be 
electronically processed in many different ways, by delivery to further 
imbedded processing and storage circuitry, or to deliver information to a 
separate or remote device, which in itself stores information for that can be 
observed, stored and /or redelivered/re-broadcast 

In one embodiment multiple cameras may be distributed in space and 
connected to each other and or a central processor by wire or wirelessly 
enabling retrieval of multiple information. This information can be assembled 
interferometrically such as a large radio telescope array or to create multiple 
viewpoints seeing around obstacles. It can also be employed as a tracking 
device enabling full 3-dimensional capability as well as a "measurement 
station" making true 3-dimensional metric determination of an unknown 
object 

Brief Description of the Drawings: 

Figure 1 is a schematic of the basic embodiment of the camera 
showing a magnified cross section. Explanation of the different layers are as 
follows: 

1 . Protective (and/or variable density filtering) cladding 

2. Lens array system, here shown a triplet optical design 

3. Partly or fully transmissive spacing and/or focusing layer shown 
with light baffles. 

4. Sensor array 

5. Connecting circuit layer 

6. Image assembling layer for the images 

7. Processing layer 

8. Control processor for light transmission and focusing 

9. Power circuit or battery 

(Note : Layer 1 , 5-9 are just given as examples of a possible configuration 
whereas layers 2-4 illustrate the essential elements described in the patent). 

Figure 2 is a schematic of a spherical or hemispherical array 
variation with wide angle coverage such as could be used on an extremely 
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small MUAV or NUAV. 

Figure 3 is a schematic of a variation which separates individual lens 
pixel elements or groups of elements to produce a virtually invisible array 
functioning as a multiple telescope array (interferometrically) useful for 
mission critical surveillance. 

Figure 4 describes the diffraction limit of the nano-lens. If the 
wavelength 560 is, for example, 560 nm (green), and the focal length is 
assumed to be 90 micrometers, then the lens diameter (assuming a constant 
of 1 .22) is^governed by 

D = 1 .22 XO/p - 1 .22 * 0.560 *90/9 = 6.83 micrometers. 
Detailed Description of the Invention 

An extraordinarily small imaging system/camera characterized by 
having a high resolution through nanofabrication and image processing in 
which the fabrication of layered elements can be applied to a flat or flexible 
base such as tape. 

Nano/macrosized optical elements arranged in an array format with 
more than one pixel per naho-sized optical element will become an imaging 
device itself rather than a light sensor (see Fig 1). 

Since an array is used, each element being at a different point gathers 
slightly different overlapping information, processing such information by 
interpolation, and/or interferometrically, one can obtain an image with much 
higher resolution than each of these multiple elements would be capable of 
individually and without a larger aperture and focal length single lens. Under 
most conditions focusing will be unnecessary due to extreme depth of field 
but may be controlled as outlined below or by the program algorithms used. 

Since each of the lens/pixel groups will have a slightly different spatial 
viewpoint, the multiple information from electronically or geometrically defined 
multiple sectors of the array of sensors e.g. left and right sector, can be 
processed to obtain 3-D or stereotypic images. 

By curving the sensor array in a 2-dimensional fashion e.g. on flexible 
tape, combined with stitching the information together a wide angle view 
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detection can be achieved where up to 360 degree panoramic imaging 
capability can be achieved. 

By spherizing the sensor array in a 3-dimensionaI fashion (see Fig 2) 
and by combining the information together by stitching, one obtains a full 360 
degree "fish-eye" imaging capability in all 3-dimensions for wide angle view 
detection. The image may be processed subsequently to produce either 
fisheye, rectilinear or other map projection formulae. 

Furthermore, multiple cameras may be distributed in space and 
connected to each other (see Fig 3) and or a central processor by wire or 
wirelessly it will be possible to enable retrieval of information from multiple 
sensors or sensor arrays. This information can be assembled 
interferometrically such as in a large radio telescope array or to create 
multiple viewpoints seeing around obstacles. It can also be employed as a 
tracking device enabling full 3-dimensional capability as well as a 
"measurement station" making true 3-dimensional metric determination of an 
unknown object. 

As in most conventional optical systems, color imaging and 
spectroscopic imaging can be achieved by utilizing equal sized lenses and 
using multi-wavelength sensing layers below the lenses. 

Furthermore spectroscopic imaging and/or spectroscopy can be 
achieved taking advantage of the unique optical properties of nano-scaled 
lenses by controlling the diameter of the lenses at a nanometer level thereby 
accepting various wavelengths below the diffraction limit as illustrated in, but 
not limited by, the two following examples: 

A) In one configuration spectroscopy can be achieved in the following 
manner. Stepwise sized lenses with gradually increasing/decreasing diameter 
could be employed by utilizing processing algorithms to remove the longer 
wavelength cumulative component of the incrementally larger lenses, e.g. the 
smallest diameter lens being capable of admitting only the UV-light waves' 
and the largest diameter lens admitting all wavelengths up to IR-radiation. 

B) In another configuration color imaging can be achieved by 
controlling the diameter of a limited set of 2, 3 or more lenses at a nanometer 
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level. Lenses with different diameters could be utilized to detect discrete 
wavelengths which subsequently are additively combined to produce a color- 
code necessary for standard color imaging (e.g. RGB, CMYK) or with similar 
processing as in example A, to produce spectroscopic imaging or false color 
processing. 

Realization of the Invention 

The shape of optical elements may be realized using ordinary 
semiconductor processing methods such as different kinds of lithography 
processes, for instance but not limited to photolithography, UV-lithography, 
EUV-Iithography, electron beam lithography, nanoimprint lithography, ion 
beam lithography, X-ray lithography as well as various kinds of embossing 
lithographies. 

The radiation sensitive elements formed in the radiation sensitive 
layer mayalso be fabricated using standard semiconductor processing 
technology as discussed for the optical elements above. 

The lenses as described above may in one embodiment be preferably 
realized by (but not limited to) using Nanoimprint lithography wherein a pre- 
patterned morphological stamp containing the inverse of the intended shape 
of the lenses is used to form a recessed structure in a polymer layer by 
mechanical indentation of the stamp into the polymer layer most often being 
melted above its glass transition temperature. The indentation into the resist 
is followed by a cooling cycle hardening the resist and then the stamp is 
removed. This NIL process can be applied both on flat and on curved 
substrates. 

In one form this described radiation sensitive layer being formed into 
individual elements is a CCD-plate as found in many digital imaging devices. 
The invention is, however, not limited to employ such CCD-plates. As an 
alternative sensitive layer (but not limited to) one can use polymeric radiation 
sensitive detectors as known in the art of polymer electronics or radiation 
detectors being made in paper similar to the art known as paper electronics. 



